The Explore VS Exploit Problem

In English, the words “explore” and “exploit” come loaded with completely opposite connotations. But to a computer scientist, these words have much more specific and neutral meanings. Simply put, exploration is gathering information, and exploitation is using the information you have to get a known good result. [...] [...] A sobering property of trying new things is that the value of exploration, of finding a new favorite, can only go down over time, as the remaining opportunities ...